Skip to content

fix: proper error handling for missing elements in messages array (OpenAI compatible backend)#13540

Merged
CISC merged 1 commit intoggml-org:masterfrom
pwilkin:piw-jinjafix
May 15, 2025
Merged

fix: proper error handling for missing elements in messages array (OpenAI compatible backend)#13540
CISC merged 1 commit intoggml-org:masterfrom
pwilkin:piw-jinjafix

Conversation

@pwilkin
Copy link
Collaborator

@pwilkin pwilkin commented May 14, 2025

Supersedes #13521

Per discussion in that PR, implement proper logic for checking messages array elements, with meaningful error messages.

@jasonmcaffee
Copy link

FWIW I pulled down these changes, verified they fixed the issue I was having with the latest bartowski-Qwen2.5-7B-Instruct-1M-GGUF-Qwen2.5-7B-Instruct-1M-Q4_K_M.gguf model, and also verified that the logic adheres to the OpenAI platform docs specification.

Nice work!

@CISC CISC merged commit c753d7b into ggml-org:master May 15, 2025
44 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Eval bug: bizarre Jinja bug when trying to fix Qwen3 tool calling

3 participants